Guild icon
S3Drive
Community / support / Windows app hangs if there's lots of data in the drive mount cache
Avatar
I tried to upload about 100GB+ of photos using the 'drive mount' feature. They copied very quickly in a few mins, obviously they are being copied to a temporary location and then S3 Drive is uploading them in the background. Once windows indicated the transfer was complete I quit S3 Drive. Obviously most of that data is uploaded yet. When starting S3 Drive now, the app hangs for around 15-20 mins, just a blank window, but I can see S3 Drive using all my upload bandwidth and photos appearing one by one if i check on my phone. I'd like to stop this upload now. Where is this temporary cache location so I can delete it and hopefully stop the transfer? And is caching needed? perhaps we can have an option to have drive mount caching turned off, (there is an option in rclone for this i think). I would find it more useful to see the actual transfer progress and know when it is completed. Thank you
👍 1
Avatar
Hi and thanks for your feedback. What's your OS? We're using VFS cache with writes setting which is pretty much required for the write mode to function properly. We could possible disable it on Windows and Linux with some limitations: https://rclone.org/commands/rclone_mount/#limitations and still keep the writes mode, but on macOS it wouldn't be possible. For Linux see: ~/.cache/rclone/vfs I would suspect it's going to be similar on Windows: $HOME/.config/rclone/vfs and macOS. Strange that S3Drive hangs, it's probably some bug where mount process takes extre ordinary time to load? the cache before returning the mount to the app and it's blocking the main thread. Deleting the VFS cache although not convenient shall resolve this issue. We will be able to provide couple more options, e..g. disable cache, set max age... and most importantly set the max size: vfs-cache-max-size. Based on your comment I've increased priority on this and you can expect improvements in one of the next releases. Just please let me know what's your OS for reference. Thanks !
Avatar
Ah nice one Tom that's great. Yeah i've realised it's not just on app start up when S3Drive hangs, but also if i start drive mount while the app is open and working. Im on Windows 10. Cheers
Avatar
Hi again, we've released hotfix in 1.7.3 which shall resolve mount blocking the app UI on Windows/Linux and there was also another issue causing issues mounting unencrypted S3 buckets on all platforms. The rest improvements regarding VFS cache will come next and soon, as we need to research topic little bit further. Please let me know if 1.7.3 behaves little bit better for you. It still doesn't address the underlying VFS issue that you've mentioned, but at least now you shall be able to go to the settings to disable mount and e.g. disable auto start if you came across any issues. Thanks !
Avatar
Thanks Tom! S3Drive was still unresponsive for 13 mins (i timed it). I wonder if the update didn't install because it's still saying 1.7.2 in the taskbar, even though the installer said 1.7.3. I've tried uninstalling and re-installing and it still says 1.7.2. Cheers (edited)
Avatar
Thanks for letting me know and sorry for the trouble, there was an issue on the build side where old executable was packaged instead (we need to fix our build scripts !), but it's now resolved, we've updated 1.7.3 build for Windows. (edited)
Avatar
No worries at all. 1.7.3 fixes this problem! Still takes a while for the drive to mount, but S3Drive is functional during this time. Thank you.
Avatar
That's great to hear, the mount settings will come next and this shall resolve most of the issues that you're experiencing. If you have any feedback on this or other functionality please let me know, we're really trying hard to mature this project.
Avatar
Hi @hugh1988, In our 1.7.6 release we've added the cache setting option, which defaults to Minimal, that is transfers are blocked until they're uploaded to the remote. Changing it to Writes changes the behavior to what it was previously. Detailed description of cache settings can be found here: https://rclone.org/commands/rclone_mount/#vfs-cache-mode-off I hope this already improves the situation.
Mount the remote as file system on a mountpoint.
Avatar
I was wondering if suggested solution here, that is setting cache to minimal solves your issue? (edited)
Exported 10 message(s)
Timezone: UTC+0